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Abstract — Most algorithms in 3D computer vision rely on 
the pinhole camera model because of its simplicity, whereas 
virtually all imaging devices introduce certain amount of 
nonlinear distortion, where the radial distortion is the most 
severe part. Common approach to radial distortion is by 
the means of polynomial approximation, which introduces 
distortion-specific parameters into the camera model and re- 
quires estimation of these distortion parameters. The task 
of estimating radial distortion is to find a radial distortion 
model that allows easy undistortion as well as satisfactory 
accuracy. This paper presents a new radial distortion model 
with an easy analytical undistortion formula, which also be- 
longs to the polynomial approximation category. Experi- 
mental results are presented to show that with this radial 
distortion model, satisfactory accuracy is achieved. An ap- 
plication of the new radial distortion model is non-iterative 
yellow line alignment with a calibrated camera on ODIS, a 
robot built in our CSOIS (See Fig. gj. 



I. Introduction 

A. Related Work: Camera Calibration 

Depending on what kind of calibration object used, there 
are mainly two categories of calibration methods: pho- 
togrammetric calibration and self-calibration. Photogram- 
metric calibration refers to those methods that observe a 
calibration object whose geometry in 3-D space is known 
with a very good precision Self-calibration does not 
need any calibration object. It only requires point matches 
from image sequence. In |2], it is shown that it is possible 
to calibrate a camera just by pointing it to the environ- 
ment, selecting points of interest and then tracking them 
in the image as the camera moves. The obvious advantage 
of the self-calibration method is that it is not necessary 
to know the camera motion and it is easy to set up. The 
disadvantage is that it is usually considered unreliable [3]. 
A four step calibration procedure is proposed in where 
the calibration is performed with a known 3D target. The 
four steps in ^ are: linear parameter estimation, nonlin- 
ear optimization, correction using circle/ellipse, and image 
correction. But for a simple start, linear parameter es- 
timation and nonlinear optimization are enough. In [S], 
a plane-based calibration method is described where the 
calibration is performed by first determining the absolute 
conic B = A~"^A~"'^, where A is a matrix formed by the 
camera's intrinsic parameters. In the parameter 7 (a 



parameter describing the skewness of the two image axes) 
is assumed to be zero and it is observed that only the rel- 
ative orientations of planes and camera are of importance 
in avoiding singularities because the planes that are par- 
allel to each other provide exactly the same information. 
The camera calibration method in [7] is regarded as 
a great contribution to the camera calibration. It focuses 
on the desktop vision system and advances 3D computer 
vision one step from laboratory environments to the real 
world. The proposed method in [Hj, |7] lies between the 
photogrammetric calibration and the self-calibration, be- 
cause 2D metric information is used rather than 3D. The 
key feature of the calibration method in |7] is that the 
absolute conic B is used to estimate the intrinsic parame- 
ters and the parameter 7 can be considered. The proposed 
technique in [S], [7] only requires the camera to observe a 
planar pattern at a few (at least 3, if both the intrinsic 
and the extrinsic parameters are to be estimated uniquely) 
different orientations. Either the camera or the calibration 
object can be moved by hand as long as they cause no sin- 
gularity problem and the motion of the calibration object 
or camera itself needs not to be known in advance. 

After estimation of camera parameters, a projection ma- 
trix M can directly link a point in the 3-D world reference 
frame to its projection (undistorted) in the image plane. 
That is 
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where A is an arbitrary scaling factor and the matrix A 
fully depends on the 5 intrinsic parameters with their detail 
descriptions in Table where some other variables used 
throughout this paper are also listed. 

The calibration method used in this work is to first esti- 
mate the projection matrix and then use the absolute conic 
to estimate the intrinsic parameters 0, |3- The detail pro- 
cedures are summarized below: 



Linear Parameter Estimation, 

- Estimation of Intrinsic Parameters; 

- Estimation of Extrinsic Parameters; 

- Estimation of Distortion Coefficients; 
Nonlinear Optimization. 

TABLE I 
List of Variables 



Variable 



k= (fci, fca) 
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Description 



3-D point in world frame 



3-D point in camera frame 



Distortion coefficients 



Distorted image points 



Undistorted image points 
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5 intrinsic parameters 



Objective function 



Camera intrinsic matrix 



Absolute conic 



Projection matrix 



function is obtained numerically via an iterative scheme. In 
|12| . for practical purpose, only one distortion coefficient 
ki is used. Besides the polynomial approximation method 
mentioned above, a technique for blindly removing lens dis- 
tortion in the absence of any calibration information in the 
frequency domain is presented in ,13, . However, the accu- 
racy reported in [1'6\ is by no means comparable to that 
based on calibration and this approach can be useful in ar- 
eas where only qualitative results are required. The new 
radial distortion model proposed in this paper belongs to 
the polynomial approximation category. 

The rest of the paper is organized as follows. Sec. ^ 
describes the new radial distortion model and its inverse 
undistortion analytical formula. Experimental results and 
comparison with existing models are presented in Sec. IIIII 
One direct application of this new distortion model is dis- 
cussed in Sec. IIVI Finally, some concluding remarks are 
given in Sec. El 

II. Radial Distortion Models 

In this paper, we focus on the distortion models while 
the intrinsic parameters and the extrinsic parameters are 
achieved using the method presented in [7]. According 
to the radial distortion model in (Q, the radial distortion 
can be resulted in one of the following two ways: 
• Transform from the camera frame to the image plane, 
then perform distortion in the image plane 
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B. Radial Distortion 

Radial distortion causes an inward or outward displace- 
ment of a given image point from its ideal location. The 
negative radial displacement of the image points is referred 
to as the barrel distortion, while the positive radial dis- 
placement is referred to as the pincushion distortion "SJ. 
The radial distortion is governed by the following equation 

F{r) = r f{r) = r (1 + kir^ + fcar^ + fcgr^ + •.•), (2) 

where fci , A;2 , ^3 , ■ • ■ are the distortion coefficients and — 

-f with (x, y) the normalized undistorted projected © becomes 



• Perform distortion in the camera frame, then transform 
to the image plane 
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points in the camera frame. The distortion is usually dom- 
inated by the radial components, and especially dominated 
by the first term. It has also been found that too high an 
order in |(5J may cause numerical instability |7], [5], |10| . 
In this paper, at most two terms of radial distortion are 
considered. When using two coefficients, the relationship 
between the distorted and the undistorted image points 
becomes 



(U - Uq) f{r) + Uq 

ax fir) +^y}{r) + uq 
axd + jyd + Uq, 
(v - Wo) f{r) + Vo 
= Pyd + VQ. 

Therefore, it is also true that 
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(5) 



Ud-uo = {u - uo) {1 + kir'^ + k2r'^) 
Vd-vo = (v - Vq) (1 -t- kir"^ + k2r'^). 



(3) 
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When using two distortion coefficients to model radial dis- 
tortion as in [Sj , , the inverse of the polynomial function 
in (PJ is difficult to perform analytically. In JT] , the inverse 



Thus, the distortion performed in the image plane can 
also be understood as introducing distortion in the cam- 
era frame and then transform back to the image plane. 



A. The Existing Radial Distortion Models 



B. The New Radial Distortion Model 



Radial undistortion is to extract {u,v) from {ud,Vd), 
which can also be accomplished by extracting (x, y) from 
{xd^ yd)- The following derivation shows the problem when 
trying to extract {x,y) from (xd,yd) using two distortion 
coefRcients ki and k2 in 

From (ud,Vd), we can calculate {xd,yd) by 
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Our new radial distortion model is proposed as: 

F{r) ^rf{r) =r{l + kir + k2r'^), (10) 

which is also a function only related to radius r. The mo- 
tivation of choosing this radial distortion model is that the 
resultant approximation of Xd is also an odd function of x, 
as can be seen next. For F{r) = rf{r) = r(l + kir + k2r^), 
we have 



where the camera intrinsic matrix A is invertible by na- 
ture. Now, the problem becomes to extracting {x, y) from 
{xd,yd)- According to igj), 
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It is obvious that a;^ = iff x = 0. When ^ 0, by letting 
c — yd/xd — y/x, we have y — cx where c is a constant. 
Substituting y ~ cx into the above equation gives 

Xd = x[l + ki{x'^ + c^x'^) + k2{x'^ + c^x'^)'^] 

= x + kiil + c')x^ + k2{l + c'fx'^. (8) 

Let f{x) = x + ki(l + c^)x^ + k2{l + c^)'^x^. Then f{-x) = 
—f{x) and f{x) is an odd function. The analytical solution 
of © is not a trivial task. This analytical problem is still 
open (of course, we can use numerical method to solve it). 
But if we set k2 = 0, the analytical solution is available 
and the radial undistortion can be done easily. In J^, for 
the same practical reason, only one distortion coefficient 
ki is used to approximate the radial distortion, in which 
case we would expect to see performance degradation. In 
Sec. mil experimental results are presented to show the 
performance comparison for the cases when k2 = and 
^2 7^ using the calibrated parameters of three different 
cameras. Recall that the initial guess for radial distortion is 
done after having estimated all other parameters (including 
both intrinsic and extrinsic parameters) and just before the 
nonlinear optimization step. So, we can reuse the estimated 
parameters and choose the initial guess for k2 to be and 
compare the values of objective function after nonlinear 
optimization. 

The objective function used for nonlinear optimization 
isEl: 



N 



-m(A,fcl,fc2,R^,t^,M,)||^ (9) 



where m(A, fci, fc2, R;, t^, Mj) is the projection of point Mj 
in the i*'' image using the estimated parameters and Mj is 
the j*'' 3D point in the world frame with = 0. Here, n 
is the number of feature points in the coplanar calibration 
object and N is the number of images taken for calibration. 



Xd = X f{r) = .T (1 + kir + fc2r^) 
yd = y f{r) = y (1 + fcir + k^r'^). 



(11) 



Again, let c = yd/xd — y/x. We have y = cx where c is 
a constant. Substituting y ~ cx into the above equation 
gives 



Xd 



1 + ki\/x^~}~(^ + k2{x^ + c^x^) 



= X 1 + fciVl + sgii(.T)a; + ^2(1 + c^)x^ 
= X -I- fci Vl + c2 sgn(x) -I- fc2 (1 -t- c^) x^ (12) 
where sgn(a;) gives the sign of x. Let 

f{x) = X + fciVl + c2 sgn(x)x^ -I- fc2(l -I- c^)x^. 

Clearly, /(x) is also an odd function. 

To perform the radial undistortion using the new distor- 
tion model in (|10|l . that is to extract x from Xd in (|12ll . the 
following algorithm is applied: 

1) X = iff Xd = 0, 

2) Assuming that x > 0, (|12|l becomes 



Xd = X + fci Vl + c^x^ + fc2(l + c^)x^. 

Using solve, a Matlab Symbolic Toolbox function, we can 
get three possible solutions for the above equation denoted 
by xi+, X2+, and X3+ respectively. To make the equations 

simple, let y = Xd, p = fciVl + c'^ and q = ^(1 -I- c^). The 
three possible solutions for y = x + px^ + qx^ are 
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From the above three possible solutions, we discard those 
whose imaginary parts are not equal to zero. Then, from 
the remaining, discard those solutions that conflict with 
the assumption that x > 0. Finally, we get the candidate 



solution by choosing the one closest to Xd if the number 
of remaining solutions is greater than 1. 

3) Assuming that x < 0, there are also three possible so- 
lutions for 

Xd = x- kiy/l + c^x^ + ^2(1 + c^)x^, (15) 

which can be written as 

y ^ X + {~p)x'^ + qx^ . (16) 

The three solutions for 116|l can thus be calculated from 
l(T^ and lfn|l by substituting p = —p. With a similar 
procedure as described in the case for a; > 0, we will have 
another candidate solution x^ . 

4) Choose among x+ and a;_ for the final solution of x by 
taking the one closest to Xd- 

The basic idea to extract x from Xd in (|12|l is to choose 
from several candidate solutions, whose analytical formula 
are known. The benefits of using this new radial distortion 
model are as follows: 

• Low order fitting, better for fixed-point implementation; 

• Explicit or analytical inverse function with no numerical 
iterations; 

• Better accuracy than using the radial distortion model 
/(r) = 1 + fcir^. 

III. Experimental Results and Comparisons 

Now, we want to compare the performance of three dif- 
ferent radial distortion models based on the final value of 
objective function after nonlinear optimization by the Mat- 
lab function f minunc. The three different distortion models 
for comparison are: 

distortionmodeli : /(r) = 1 + kir^ + ^2?"^, 
distortionmodel2 : /(r) = 1 + fcir^, 
distortionmodels : /(r) = 1 -|- kir + k2r'^ . 

Using the public domain test images (T^ , the desktop cam- 
era images J^l (a color camera in our CSOIS), and the 
GDIS camera images JS] (the camera on ODIS robot built 
in our CSOIS, see Sec. ITV-H and Fig. P), the final ob- 
jective function (J), the 5 estimated intrinsic parameters 
(a, /?, 7, uq, wo)j and the estimated distortion coefficients 
(fci, /c2) are shown in Tables HTIlIIII and llVl rcspcctivelv |15| . 
The results show that the objective function of models is 
always greater than that of modeli, but much smaller than 
that of model2, which is consistent with our expectation. 
Note that, when doing nonlinear optimization with differ- 
ent distortion models, we always use the same exit thresh- 
olds. 

To make the results in this paper repeatable 
by other researchers for further investigation, we 
present the options we use for the nonlinear op- 
timization: options = optimset ( 'Display ' , 'iter', 
' LargeScale ' , ' of f ' , ' MaxFunEvals ' , 8000 , ' TolX ' , 
10"^ 'TolFun', 10"^, 'Maxlter', 120). The raw 
data of the extracted feature locations in the image plane 
are also available upon request. 



A second look at the results reveals that for the cam- 
era used in [^1, 14 , which has a small lens distortion, 
the advantage of models over model2 is not so significant. 
When the cameras are experiencing severe distortion, the 
radial distortion models gives a much better performance 
over model2, as can be seen from Tables Hill and HVl 
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Fig. 1 

The mechanical and vetronics layout of ODIS 



TABLE II 

Comparison of Distortion Models Using Images in * 



Microsoft Images 


Model 


#1 


#2 


#3 


J 


144.88 


148.279 


145.659 


a 


832.5010 


830.7340 


833.6623 


7 


0.2046 


0.2167 


0.2074 


Wo 


303.9584 


303.9583 


303.9771 


/3 


832.5309 


830.7898 


833.6982 


vo 


206.5879 


206.5692 


206.5520 


ki 


-0.2286 


-0.1984 


-0.0215 


k2 


0.1903 





-0.1565 



*(A;i,A;2) for modeli and inodel2 are defined in J^J and (^1,^2) for 
models is defined in llUi . 

IV. Application: Non-iterative Yellow Line 
Alignment with a Calibrated Camera on 
ODIS 

A. What is ODIS? 

The Utah State University Omni-Directional Inspection 
System) (USU ODIS) is a small, man-portable mobile 
robotic system that can be used for autonomous or semi- 
autonomous inspection under vehicles in a parking area 
[THj , JJj , PS] • The robot features (a) three "smart wheels" 
[TO] in which both the speed and direction of the wheel 
can be independently controlled through dedicated pro- 
cessors, (b) a vehicle electronic capability that includes 
multiple processors, and (c) a sensor array with a laser, 
sonar and IR sensors, and a video camera. A unique fea- 
ture in ODIS is the notion of the "smart wheel" developed 



TABLE III 

Comparison of Distortion Models Using Desktop Images in [JS] 



Desktop Images 
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WO 
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778.9768 


904.68 


803.307 


a 


277.1457 


275.5959 


282.5664 


7 


-0.5730 


-0.6665 


-0.6201 


Uq 


153.9923 


158.2014 


154.4891 


(3 


270.5592 


269.2307 


275.9040 


vo 


119.8090 


121.5254 


120.0952 


ki 


-0.3435 


-0.2765 


-0.1067 


k2 


0.1232 





-0.1577 



TABLE IV 

Comparison of Distortion Models Using ODIS Images in 



ODIS Images 


Model 


#1 


#2 


#3 


J 


840.2650 


933.098 


851.262 


a 


260.7636 


258.3206 


266.0861 


7 


-0.2739 


-0.5166 


-0.3677 




140.0564 


137.2155 


139.9177 


P 


255.1465 


252.6869 


260.3145 


Vo 


113.1723 


115.9295 


113.2417 


ki 


-0.3554 


-0.2752 


-0.1192 


k2 


0.1633 





-0.1365 



by the Center for Self-Organizing and Intelligent Systems 
(CSOIS) at USU which has resulted in the so-called T- 
series of omni-directional (ODV) robots jl^j. With the 
ODV technique, our robots including ODIS, can achieve 
complete control of the vehicle's orientation and motion in 
a plane, thus making the robots almost holonomic - hence 
"omni-directional" . ODIS employs a novel parameterized 
command language for intelligent behavior generation jl7| . 
A key feature of the ODIS control system is the use of an 
object recognition system that fits models to sensor data. 
These models are then used as input parameters to the mo- 
tion and behavior control commands .16^ . Fig. ^ shows the 
mechanical layout of the ODIS robot. The robot is 9.8 cm 
tall and weighs approximately 20 kgs. 

B. Motivation 

The motivation to do camera calibration and radial 
undistortion is to better serve the wireless visual servoing 
task for ODIS. Our goal is to align the robot to a park- 
ing lot yellow line for localization. Instead of our previous 
yellow line alignment methods described in ^H], [201, we 
can align to the yellow line with a non-iterative way using 
a calibrated camera. The detail procedure is discussed in 
the next section. 

C. Localization Procedure 

Let us begin with a case when only ODIS's yaw and 
x,y positions are unknown while ODIS camera's pan/tilt 
angles are unchanged since calibration. The task of yellow 



line alignment is described in detail as follows: 

* Given: 

— 3D locations of yellow line's two ending points 

~ Observed ending points of yellow line in the image plane 
using ODIS camera 

— ODIS camera's pan/tilt angles 

— ODIS camera's intrinsic parameters 

— Radial distortion model and coefficients 

• Find: ODIS's actual yaw and x,y positions 

Knowing that a change in ODIS's yaw angle only results 
in a change of angle s in the ZYZ Euler angles (a, b, s). So, 
when using ZYZ Euler angles to identify ODIS camera's 
orientation, the first two variables a, b are unchanged. In 
Fig. 13 after some time of navigation, the robot thinks it is 
at Position 2, but actually at Position 1. Then it sees the 
yellow line, whose locations in 3D world reference frame 
are known from map (denoted by Pai and Pbi)- After 
extracting the corresponding points in the image plane of 
the yellow line's two ending points, we can calculate the 
undistorted image points and thus recover the 3D locations 
of the two ending points (denoted by Pa 2" ^^'^ using 
ODIS camera's 5 intrinsic parameters and radial distortion 
coefficients. From the difference between the yellow line's 
actual locations in map and the recovered locations, the 
deviation in the robot's x,y positions and yaw angle can 
be calculated. 




Fig. 2 

The task of yellow line alignment 



Let (x, y) be the undistorted points in the camera frame 
corresponding to the yellow line's two ending points in the 
3D world frame. Let R2 and t2 be the rotation matrix and 
translation vector at position 2 (where the vehicle thinks it 
is at), similarly i?i and ti at position 1 (the true position 
and orientation), we can write R2 — AR ■ Ri and t2 — 
ti -I- At, where AR and At are the deviation in orientation 
and translation. If the transform from the world reference 
frame to the camera frame is P'^ = R~^{P'^ — t), first we 
can calculate Pa 2' ^'^id Pb2 ■ 



Let Pa\ 
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0] , we have 



Xa2 ~ ^21 
Ya2 ^ ^22 
— 123 
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(18) 



we have two equations containing two variables and Pa™ 
can be calculated out. By the same way, we can get Pb2 ■ 
Once Pa 2' s-'^d Pb^ are known, we have 



A2 



where A is a scaling factor. From (|19|l . we get 

i?2-MAi?(PAr - ti) - pa^ + 12] = 0. 

Similarly, we get 

R^^[^R{PB'^ - ti) - Pb^2" + t2] = 0. 

Using the above two equations, we have (Pa™ 
AR{Pai - Pbi), where AR is of the form 



AP 



cos(A6l) -sin(A6l) 
sin(A6') cos(A6') 
1 



), (19) 

(20) 
(21) 

(22) 



So, A9 is just the rotation angle from vector Pa™ Pb^ 
to vector Pa^ Pb2 ■ When AP is available, ti can be 
calculated as ti = Pa™ - AP"^(Pa™ - t2). 

V. Concluding Remarks 

This paper proposes a new radial distortion model that 
belongs to the polynomial approximation category. The 
appealing part of this distortion model is that it preserves 
high accuracy together with an easy analytical undistor- 
tion formula. Experiments results are presented showing 
that this distortion model is quite accurate and efhcient 
especially when the actual distortion is significant. An ap- 
plication of the new radial distortion model is non-iterative 
yellow line alignment with a calibrated camera on ODIS. 
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